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Technological advances are continually increasing the economic 
viability of efficient codecs in telephone networks. A subjective eval- 
uation is described here of the /i255 Pulse Code Modulation (PCM) al- 
gorithm and three more efficient techniques, Nearly Instantaneous 
Companding PCM (NIC PCM), Cummiskey -J ay ant -Flanagan Adaptive 
Differential PCM (ADPCM), and Subscriber Loop Carrier Adaptive 
Delta Modulation (SLC* ADM). These codecs are compared under the 
conditions of: (i) single encodings as a function of line bit rate, input 
level, received volume, and error rate, (ii) tandem encodings with in- 
termediate baseband conversion, and (Hi) local, exchange, and toll 
network reference connections where mixed tandem encodings might 
be found along with typical analog impairments such as loss and ran- 
dom noise. The simulation of the codec algorithms on a minicomputer 
facility enabled the production of subjective test tapes containing 
speech processed under these conditions. These tapes were then eval- 
uated in listening-type subjective tests. It is shown that (i) NIC PCM, 
ADPCM, and SLC ADM have approximately a 12- to 16-kb/s advantage 
over \i255 PCM for equivalent subjective ratings, (ii) NIC PCM, ADPCM, 
and SLC ADM perform comparably over the range of conditions tested; 
and {Hi) 64-kb/s ^255 PCM can be deployed in a multiple encoding 
environment with very few restrictions, whereas the use of lower bit rate 
NIC PCM, ADPCM, and SLC ADM codecs would necessitate more strin- 
gent application rules to avoid excessive degradation in tandem en- 
coding situations. 



* Trademark of Western Electric. 
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I. INTRODUCTION 

In recent years, a great amount of interest has been expressed in the 
literature on the subject of efficient encoding of voiceband signals. Much 
of this interest stems from the economics of bandwidth reduction that 
are possible with efficient codecs. Waveform codecs such as differential 
PCM (DPCM), adaptive differential PCM (ADPCM), delta modulation 
(DM), and adaptive delta modulation (ADM) are considered for general 
use in telephone networks because, among other reasons, they often are 
a reasonable compromise between the bandwidth required of the 
transmission channel and the terminal complexity at the ends of the 
channel. 

Aside from the economics, there is the issue of degradations introduced 
by a codec in speech and voiceband signals. In fact, a signal may undergo 
a number of encodings by codecs of different types as it progresses 
through the network. An example of this is the hypothetical network of 
Fig. 1. Here, a mixture of analog and digital switching and transmission 
facilities are represented. 

The toll portion of the network incorporates analog toll switches such 
as the No. 4 crossbar and the digital No. 4 ESS switch. The D channel 
banks and VIF terminals are shown in order to point out where analog - 




. ANALOG FORMAT 



DIGITAL FORMAT 

D = D CHANNEL BANK 

V = VOICEBAND INTERFACE FRAME (VIF) 



Fig. 1 — Possible codec deployment in ddd network. 
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to-digital conversions take place. The coding law currently used in Bell 
System D channel banks is 64-kb/s ^255 PCM. 1 

The exchange network environment favors the deployment of efficient 
codecs because of the investment in the exchange and loop plants. 
Subscriber carrier and remote switching systems may be installed on 
loops and interfaced directly to a digital central office. Other carrier 
systems may be implemented by a digital-to-digital (D/D) conversion 
from one code format to another more efficient format as shown in the 
exchange trunk example of Fig. 1. 

The point is that a telephone call can be routed over a variety of con- 
nections in this network and might be subjected to 64-kb/s /x255 PCM 
encodings in the toll plant in tandem with other codecs found in the local 
environment. The goal of the studies reported in this paper is to gain 
insight into the subjective effects of a multiple encoding environment 
on speech. Another important component of this goal is the impact of 
this environment on voiceband data. However, the resources and time 
consumed by the speech studies did not allow simultaneous work on 
voiceband data in the context of this study. 

Prior to the evaluation of the overall subjective effect of a network 
environment on speech, the contributions of the various components 
of the network must be well understood. The analog components can 
be represented by transmission impairments such as loss and additive 
random noise. 2 The performance of a digital component of a connection 
is a function of the quantizing noise characteristics of the digital en- 
coding, the line bit rate, the speech input level to the codec, and trans- 
mission impairments such as bit errors, slips, and misframes. The initial 
step of the study concentrated on the evaluation of some of these im- 
pairments for single encodings by selected codecs. Next, the codecs were 
tandemed with themselves under controlled conditions in order to es- 
tablish the multiple encoding behavior without the complications of more 
than one coding law. Finally, selected codecs were incorporated into a 
set of reference network connections. These reference connections are 
representative of Bell System local and toll connections with charac- 
teristics (loss, noise, talker volume) that are derived from survey 
data. 

The purpose of this paper is to report on recently completed subjective 
tests of digital codecs. Detailed results of the tests are presented and 
preliminary analyses are discussed. However, another objective of these 
tests is to provide a sufficiently large data base to enable the development 
of analytic models of subjective behavior. These models would be used 
to predict the performance resulting from the introduction of digital 
codecs in an evolving telephone network. 
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II. CODEC ALGORITHMS 

Four basic codec algorithms were evaluated: (i) /x255 PCM, 3,4 
(ii) Nearly Instantaneous Companding (NIC) PCM, 5 (Hi) Cummiskey- 
Jayant-Flanagan ADPCM, 6 and (iv) Subscriber Loop Carrier (SLC*) 
ADM. 7 These four were chosen for one or more of the following reasons: 
interest in the algorithm, availability of a well-defined solftware algo- 
rithm in the time frame of these tests, total number of test conditions 
to be generated, and the existence of a hardware implementation of the 
codec. These codecs are samples of four different classes of waveform 
codecs, but each chosen codec is quite specific and the reader is cautioned 
against generalizing the results for a particular codec to an entire class 
of codecs. Note that NIC PCM, ADPCM, and SLC ADM employ adaptive 
quantization (or companding) but none of the codecs incorporates 
adaptive prediction. 

A brief description of some of the characteristics of each algorithm 
is given here which, in conjunction with the references, should aid the 
reader in understanding the similarities and differences among the al- 
gorithms when the results are discussed. 

2.1 m 255 PCM 

Three versions of the /x255 PCM algorithm were included in the tests: 
the continuous law compandor 3 with a mid-tread bias and the 15- 
segment version 4 of the /z255 compandor with both a mid-tread and a 
mid-riser bias. However, most of the attention is focused on the 15- 
segment mid-tread algorithm, since this algorithm at 64 kb/s is used in 
Bell System D channel banks. + Since the idle channel noise of a mid- 
tread algorithm implemented on a computer is essentially nonexistent, 
16 dBrnCO of random noise is introduced at the outputs of both mid- 
tread algorithms. This level of noise is intended to represent that which 
could be achieved in a hardware implementation. The overload point 
in all three cases is set at the peak amplitude of an inband sine wave with 
an rms power of +3 dBmO. 

2.2 NIC 

This algorithm is a block encoding scheme 5 which compresses L-bit, 
15-segment ^255 PCM (L ^ 4) to L — 2 bits. In this application, there are 
eight samples to a block. The largest segment number in the block is 
found and transmitted to the far-end decoder. The eight L-bit /*255 
samples are then digitally reencoded into L — 2 bit uniform samples with 
an overload point at the top of the largest segment in the block. This 
yields a bit rate of [8 X (L - 2) + 3] kb/s for an 8-kHz sampling rate, 
where the 3-kb/s component represents the transmission of the maxi- 



* Trademark of Western Electric. 

t Except for older Dl channel banks, where 56-kb/s jdOO PCM is used. 
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mum segment number in the block every millisecond. The NIC algorithm 
is biased mid-tread for L > 7 bits and mid-riser for L < 6 bits. As in the 
PCM algorithms described above, 16 dBrnCO of noise is added to the 
decoder output during mid-tread operation, and the overload point is 
set at +3 dBmO. 

2.3 ADPCM 

The Cummiskey-Jayant-Flanagan ADPCM algorithm 6 was chosen 
using a first-order predictor in the feedback loop with a time constant 
of 0.43 ms. For line bit rates greater than or equal to 32 kb/s (L > 4 
bits/sample at 8-kHz sampling), the minimum quantizer step size is 
equal to twice the interval on the first chord of the 8-bit m255 PCM 
quantizer. For L < 4, the minimum step-size is increased by the factor 
(5 - L) over the step-size for L ^ 4. For all values of L, the ratio of the 
maximum step-size to the minimum step-size is 128, identical to the 8-bit 
^255 PCM algorithm. No amplitude overload point was set for this al- 
gorithm, since it is a differential codec, but for L = 4 the algorithm is 
driven into slope overload with a 425-Hz sine wave at +6 dBmO. A 
modification of this algorithm was also investigated to determine the 
subjective effect of line bit errors. This modification was the introduction 
of step-size leak into the step-size adaptation logic. Normally, 

A, ■OfAj-b 

where A, is the quantizer step-size at a particular sample interval i and 
a, is the corresponding adaptation coefficient. An error in the trans- 
mission of the bit stream to the decoder will cause an error in the decoder 
step-size adaptation. The effect of bit errors can be minimized some- 
what by the addition of step-size leak, so that 

A, = a,(A,-i)7, 

where y is less than but nearly equal to unity. In our application, y is 
chosen to be 31/32. This limits the effect of an error at the decoder so that 
the encoder and decoder step-sizes eventually track each other. However, 
the adaptation process remains affected by the step-size leak in the ab- 
sence of errors, and discernible distortion may be introduced into 
the speech. 

2.4 SLC ADM 

The ADM algorithm chosen was the SLC-40 algorithm. 7 It is currently 
deployed at a sampling rate of 37.7 kHz in a 40-channel loop carrier 
system. Of the three non-PCM coding schemes described in this section, 
it is the only one in commercial use in the Bell System, with approxi- 
mately 1800 systems installed in the field to date. This algorithm uses 
an adaptive step-size where the step-size is altered whenever four suc- 
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cessive like sign bits are transmitted on the line. The predictor in the 
feedback loop has a main time constant of 0.7 ms. The minimum step- 
size is set to achieve an idle channel noise of 15.5 dBrnCO at 37.7 kb/s. 
This codec is driven into slope overload with a +6 dBmO input sine wave 
at a frequency of 800 Hz. 

III. SIMULATION SYSTEM 

3.1 Overview of system 

A minicomputer facility which was developed at Bell Laboratories in 
Holmdel, N.J., is briefly described in this section. A detailed description 
of its capabilities and operation can be found in Ref. 8. 

This system has four important characteristics: (i) the system con- 
figuration is independent of any particular codec algorithm; (it) the 
system is conducive to experimentation and development of a desired 
codec algorithm; {Hi) the system is capable of simulating a network 
connection containing mixed tandem encodings of several codecs; and 
(iv) the system is capable of automatic production of audio tapes suitable 
for subjective evaluation. All the codec test conditions discussed in this 
paper were simulated on this system. 

Two PDP*-11 minicomputers are interfaced with uniform 15-bit A/D 
and D/A converters. The system is capable of real-time operation at 
sampling rates up to 72 kHz. A particular codec algorithm can be im- 
plemented on this system as long as the sampling rate of the codec is less 
than 72 kHz; the codec distortion dominates the 15-bit A/D and D/A 
converter distortion; and differences between hardware and software 
versions of the codec are recognized and accounted for. 

3.2 Hardware configuration 

Referring to Fig. 2, PDP 11/40 and 11/20 minicomputers are used, each 
having 28K words (16 bits/word) of memory. Each minicomputer is in- 
terfaced to a dedicated Tustin series 1500 A/D and D/A converter sys- 
tem. The A/D and D/A converter systems were measured and adjusted 
to ensure that they were capable of at least theoretical 14-bit accuracy 
so that the waveform codecs of Section II could be simulated. 

A 1.25-million-word disk system was installed on each machine with 
a nine-track tape drive interfaced on the 11/40 for mass storage. The tape 
format is standard, so that large amounts of data can be transferred to 
other more powerful computer facilities for processing. An Ampex AG- 
440G analog tape unit is also controlled by the 11/40 so that high-quality 
audio tapes can be automatically prepared for subjective testing. 

In addition to the dedicated equipment on each processor, there is a 
UNIBUS* window between the two machines to allow interprocessor 



* Registered trademark of Digital Equipment Corporation. 
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Fig. 2 — Codec simulation facility. 



communication and data transfer. This equipment is essential for the 
automatic generation of tandem encodings. 

3.3 Facility operation 

Referring to the lower left-hand portion of Fig. 2, a segment of an 
analog signal such as speech is derived from a tape recorder, telephone 
set, or other source. The signal is bandlimited, quantized, and stored on 
either tape or disk. The choice of tape or disk is determined from two 
considerations, the sampling rate of the A/D converter and the length 
of the analog segment to be digitized. The disk can store samples at rates 
up to 72 kHz, the magnetic tape up to 16 kHz. However, a 2400-foot tape 
reel can store 10 million words, the disk only 1.25 million words. 

After the digits are stored on either tape or disk, they can be processed 
by a codec algorithm and stored back on magnetic tape or disk in prep- 
aration for playback. The output signal of the D/A converter is passed 
through a reconstruction filter and the codec simulation is essentially 
completed. The resultant analog signal can be stored on an audio tape 
recorder as indicated by the "single encoding" path in Fig. 2. 

If a tandem encoding is to be simulated, the "switch" following the 
reconstruction filter is positioned to the input of the A/D converter of 
the 11/20. As the playback operation is proceeding on the 11/40, a si- 
multaneous acquisition process is proceeding at the 11/20. The D/A on 
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the 11/40 and the A/D on the 11/20 can be timed by independent clocks. 
Hence, the overall D/A-A/D process can be performed asynchronously. 
After the acquisition at the 11/20 is complete, the 11/40 retrieves the 
samples from the disk system of the 1 1/20 via the UNIBUS window. The 
samples then reside on the magnetic tape unit or disk system of the 11/40. 
A second codec processing can take place in an identical manner as de- 
scribed above. A tandem encoding loop is thus defined. This loop is il- 
lustrated in the upper portion of Fig. 2. A signal can be made to traverse 
this loop as many times as desired, with no restrictions on sampling rate 
or codec type for each successive encoding. When the desired number 
of tandem encodings are completed, the signal can be stored on audio 
tape as in the single encoding case. Both the single and tandem encoding 
operations are performed under the automatic control of the software. 
Manual intervention after each loop is not necessary. 

IV. SUBJECTIVE TESTING— TECHNIQUES 

The subjective tests described in this paper were all conducted as 
listening-only tests (not conversational). The subjects listened to pre- 
recorded speech and voted on the perceived quality. Details concerning 
the test facilities, selection of subjects, test circuitry, and test adminis- 
tration are covered in this section. 

4. 1 Description of tests and facilities 

The subjective tests were conducted in an acoustically treated test 
room containing 11 cubicles permitting up to 11 subjects to be tested 
simultaneously. Each cubicle contains a handset over which test con- 
ditions are heard and a keyboard with five keys labeled "excellent," 
"good," "fair," "poor," and "unsatisfactory," which is used for registering 
the vote for each test condition. Associated with the keyboard are red 
indicator lights which are lit during the presentation of a test condition 
and green indicator lights which are lit to indicate the period for voting 
on the test condition. 

The votes of each subject are recorded using a minicomputer system, 
a keyboard interface, and associated programs. A terminal permits 
monitoring of the ratings during the tests. All votes are recorded on 
magnetic tape for subsequent analysis. 

At the start of the test session, a start signal is sent by the test ad- 
ministrator to the computer which then remotely actuates the tape re- 
corder and turns on the red keyboard lights. At the end of each test 
condition, a tone recorded on the second track of the test tape is recog- 
nized by a tone detection circuit which signals the computer to stop the 
recorder and turn on the green voting lights. The computer then collects 
the votes. After all the votes are received from the subjects or after a 
3-second timeout period (whichever occurs first), the computer extin- 
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guishes the green voting lights, turns on the red keyboard lights, and then 
starts the tape recorder for the next test condition. 

4.2 Test playback system 

The system used for the subjective tests is shown in Fig. 3. A dual-track 
tape recorder (Ampex 440G) equipped with a Dolby noise reduction unit 
is used to drive a standard 500-type telephone set (with a receiving rating 
efficiency of 21 dB) connected to 6 kft of 26-gauge, nonloaded cable and 
a 400-ohm, 48-Vdc feeding bridge (central office battery supply circuit). 
The carbon transmitter is replaced with a 90-ohm resistor to eliminate 
any room noise pickup. The master telephone set receiver is replaced 
by a 120-ohm resistor to avoid possible introduction of acoustic/inductive 
interference in the test conditions; a transformer-amplifier bridge on 
this resistor drives the 11 telephone set receivers in the cubicles as shown 
in Fig. 3. 

The measured responses of the playback system are shown in Figs. 
4 and 5. These responses reflect adjustment of the listening amplifier 
such that a speech level of -29 VU (volume units) at the line terminals 
of the telephone set (point V 2 of Fig. 3) produces an acoustic pressure 
of -12 dBPa* (82 dB relative to 20 ^Pa) for speech power averaged across 
the 11 receivers. The value of -12 dBPa approximates the preferred 
speech pressure level. 

4.3 Subject selection and test administration 

Subjects were selected from employees in various job classifications 
and age groups at Bell Laboratories in Holmdel, N.J. The sheer number 
of test conditions dictated that the total test program be divided into 
five tests. All the tests were administered independently of one another 
using different subjects. The number of subjects and breakdown ac- 
cording to sex is given in Table I. Discussions of the testing throughout 
the remainder of this paper will be structured under the three topics of 
(i) single encodings, (ii) tandem encodings, and (Hi) the local, exchange, 
and toll reference connections. 

For each test session, a maximum of 11 test subjects were seated in 
the test cubicles and supplied with test instructions shown in Fig. 6. The 
test administrator read the instructions and told the subjects that there 
would be four practice test conditions given before the start of the test. 
The subjects were told to vote on the four practice conditions as if they 
were part of the actual test. After the practice conditions were presented 
and voted on, the test administrator would enter the test room to answer 
any questions before the actual testing began. 



* dBPa = dB relative to 1 Pascal which corresponds to 1 newton per square meter. 
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Fig. 4 — Test signal levels. 
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Fig. 5 — Response measurements for playback system. 
4.4 Speech sources and anchoring conditions 

The source tapes were made by recording male and female speech from 
the output of a 500-type telephone set carbon transmitter through a 111C 
repeater coil and a simulated 6-kft loop using a Dolby noise reduction 
unit. These sources were then processed by the various codec algorithms 
to produce the test conditions. 

Analog noise conditions were included in each test session along with 
codec conditions. The analog noise conditions were generated by adding 
white noise bandlimited from 200 Hz to 3.4 kHz to the speech so that, 
with the speech level set at -29 VU at the 500-type telephone set ter- 
minals, the noise is at a level of 10, 20, 30, or 40 dBrnC. The inclusion of 
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Table I — Number of subjects 



Test Total Male Female 

(/) Single Encodings — Variation of Line Bit Rates and 51 37 14 

Levels 

07) Single Encodings — Error Rate 52 35 17 

(iit) Tandem Encodings plus Local and Exchange 53 49 4 

Reference Connections 

(j'd) Toll Reference Connections— Parti 56 46 10 

(v) Toll Reference Connections— Part 2 54 50 4 



Till.; EXPERIMENT IS DESIGNED TO STUDY Till: EFFECTS I >K VARIOUS 
IMPAIRMENTS ON TELEPHONE TRANSMISSION QUALITY. YOUR TASK 
IS TO LISTEN TO THE TEST CONDITIONS AND, AFTER EACH CONDITION, 
MAKE A JUDGMENT Of THE TRANSMISSION QUALITY. A JUDGMENT CAN 
BE MADE IN ONE OF FIVE CATEGORIES: EXCELLENT, GOOD, FAIR, 
POOR, AND UNSATISFACTORY. 

THE EXPERIMENT WILL CONSIST OF TWO PARTS, EACH CONTAINING 
TEST CONDITIONS, WITH A REST PERIOD BETWEEN THE TWO PARTS. 
THE TOTAL TIME OF THE TEST WILL BE ABOUT 60 MINUTES. 

WHEN THE SIGNAL IS GIVEN, PLEASE PICK UP THE WHITE PRINCESS® 
TELEPHONE HANDSET IN FRONT OF YOU AND HOLD IT TO YOUR TELE- 
PHONE LISTENING EAR. FOR EACH TEST CONDITION, YOU WILL HEAR 
THREE SENTENCES. AT THE END OF THE SENTENCES, A GREEN LIGHT 
ON THE KEYBOARD IN FRONT OF YOU WILL BE LIGHTED. DURING THE 
TIME THE GREEN LIGHT IS LIGHTED, YOU ARE TO RATE THE TRANS- 
MISSION QUALITY OF THE TEST CONDITION YOU JUST HEARD BY PUSH- 
ING ONE OF THE FIVE MARKED BUTTONS ON THE KEYBOARD AS FOLLOWS: 
EXCELLENT, GOOD, FAIR, POOR, AND UNSATISFACTORY. 

PLEASE FILL OUT THE CARD IN FRONT OF YOU. 

ARE THERE ANY QUESTIONS? 

Fig. 6 — Test instructions. 



these noise conditions allowed the codec results to be referenced or an- 
chored into the body of information that has been accumulated over the 
years on the effects of random noise. It is estimated that the background 
noise contribution from the original source tape was approximately 4 
dBrnC measured at the line terminals of the telephone set. 

Speech-correlated noise conditions were included because they ap- 
proximate ^255 PCM quantizing noise and can be utilized in future 
modeling efforts. These conditions were produced by a device called the 
Modulated Noise Reference Unit (MNRU). 9 This introduces a noise 
signal to the input speech, which is directly correlated to the instanta- 
neous amplitude of the speech. The speech-correlated noise conditions 
were designated Q = 5, Q = 10, etc., where Q is equal to the decibel value 
of the ratio of the speech power to speech correlated noise power. 

In addition to the reasons given above, the analog noise and Q con- 
ditions served as control conditions by being included in every test ses- 
sion as a check on session-to-session differences. 
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4.5 Analysis of results 

The votes from each test condition are combined into a vote histogram 
with the votes for male and female speech pooled together. These his- 
tograms contain the number of votes recorded for each of the comment 
categories "excellent," "good," "fair," "poor," and "unsatisfactory" as 
represented by the category numbers 5, 4, 3, 2, and 1, respectively. A 
Mean Opinion Score (MOS) is calculated for each test condition by taking 
the arithmetic mean of the category numbers voted. A sample standard 
deviation (a) is also calculated for each vote histogram. 

The male and female results are combined because a simple regression 
analysis of the data indicated that there was little difference between 
the subjective responses for male and female speakers (about 0.2 to 0.4 
of a category point). The overall standard deviation of the data is on the 
order of 0.6 to 0.7 of a category point. 

V. SUBJECTIVE TESTING— SINGLE ENCODINGS 

The first round of subjective testing involves single encodings of ^255 
PCM, NIC, ADPCM, and SLC ADM as a function of three parameters; line 
bit rate, input level and received volume (listening level) pairs, and line 
error rate. 

5.1 Test design 

Table IIA lists the test conditions as a function of line bit rate. Three 

Table IIA — Single encoding versus line bit rate conditions 



Algorithm 




Bit Rate (kb/s) 


Continuous Law PCM (mid-tread bias) 
15-Segment PCM (mid-tread bias) 
15-Segment PCM (mid-riser bias) 
NIC PCM 

ADPCM (with step-size leak) 
ADPCM (without step-size leak) 
SLC™ ADM 




16,40,64 

32,40,48,64 

32,48 

19,35,43,51,59 

16,24,32,40,48 

16,24,32,48 

24,37.7, 48 


Table IIB — Single encoding versus 


level variation conditions 


Algorithm 




Bit Rate (kb/s) 


15-Segment PCM (mid-tread bias) 

NIC PCM 

ADPCM (with step-size leak) 

SLC ,¥ ADM 




48 
51 

48 
48 


Input Level (VU) 


Received Volumes (vu) 


-0.2 

-10.5 
-20.7 
-31.0 
-41.2 


-20.7,- 

-20.7,- 

-29.0,- 

-38.3 

-47.0 


-29.0 

-29.0,-38.3 

-38.3 
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Table IIC — Single encoding versus error rate conditions 

Algorithm Bit Rate (kb/s) 

15-Segment PCM (mid-tread bias) 48 

NIC PCM 51 

ADPCM (with step-size leak) 48 

SLC™ ADM 48 

versions of the /x255 PCM algorithm are included mainly for verifying that 
the subjective differences between continuous law, 15-segment mid- 
tread, and the 15-segment mid-riser algorithms are negligible. ADPCM 
is simulated with and without step-size leak. To economize on the total 
number of test conditions, various line bit rates are excluded with care 
taken so that subjects are exposed to a wide subjective quality range and 
the subjective ratings of these exclusions can be estimated by interpo- 
lation. The input speech level for these conditions is —24.8 VU (~ —23.4 
dBm), the average reported by McAdoo 10 for local calls over the Bell 
System message network. The measured idle channel noise of each codec 
is given in Table III. The received volume presented to the subject is 
—29 VU, measured at the line terminals of the telephone set. 

The conditions for single encoding as a function of input level and 
received volume are arrived at by estimating Bell System speech volumes 
and network losses for five types of network connections: (i) intra- 
building, (ii) interbuilding over a direct trunk, (Hi) interbuilding over 
two tandem trunks, (iu) and (u) long and short connections over the 
intertoll network. For each of these five situations, the encoder and de- 
coder of a codec are postulated to be located in the telephone set, end 
office, and at an intermediate point in the loop as in the example of a 
remote switching or pair gain system. Speech volume 10 and loss 11 dis- 
tributions are used to derive the input level and received volume ranges 
to be tested. A condition is then defined by quantizing these ranges and 
assigning input level-received volume pairs to a codec where the received 
volume is always less than the input level. The four codecs are imple- 
mented at a single bit rate which is equal to 48 kb/s or as close to 48 kb/s 
as possible (51 kb/s in the case of NIC). This particular line bit rate is 
chosen for two reasons: (i) the large number of possible test conditions 
to be evaluated dictated the use of a single line bit rate, and (ii) that line 
bit rate should be 48 kb/s since experience has shown that the distortion 
introduced by a single encoding of /*255 PCM at 48 kb/s can be barely 
perceived and it is desirable to ascertain and compare the performance 
of the other codecs at a comparable line bit rate. Table IIB lists the 
codecs and the input level-received volume matrix used in this section 
of testing. 

The third and final portion of the single encoding tests is concerned 
with the subjective effect of random transmission errors. Independent 
errors are introduced between the encoder and decoder at rates 10" 1 , 
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10~ 2 , 10~ 3 , 10~ 4 , and 10~ 5 errors/bit. The four codecs are chosen to op- 
erate at a line bit rate equal to or nearly 48 kb/s for the same reasons 
given in the previous paragraph. The input level is set at —12.4 VU so that 
the entire dynamic range of the PCM and NIC codecs is exercised without 
overloading. A summary of the error rate test conditions appears in 
Table IIC. 

5.2 Results and observations 

The combined results for single encodings as a function of line bit rate, 
input level and received volume, and line error rate are given in the ap- 
pendix, Tables V, VI, and VII, respectively. Most of these tabulated 
results are summarized in Figs. 7 through 10. 

Figure 8 is a plot of the mean opinion score (MOS) versus line bit 
rate for the codecs of Table IIA. It is recalled that these results are ob- 
tained using an input speech level of -24.8 VU with a received volume 
of -29 VU, representing a 4.2-dB loss located after the decoder. An im- 
mediate observation that can be drawn is the subjective advantage of 
all the adaptive codecs (NIC, SLC ADM, and ADPCM) over the /x255 PCM. 
Below a line bit rate of 48 kb/s, this advantage is on the order of 12 to 16 
kb/s for equivalent subjective ratings. At 48 kb/s and above, the leveling 
off of the response curves is due to two effects. The first important factor 
is the absolute level of idle channel noise the subjects hear. The idle 

Table III — Single encoding idle channel noise measurements 





Bit Rate 


Idle Channel Noise 


Algorithm 


(kb/s) 


(dBrnC) 


True Logarithmic PCM (mid-tread) 


16 


16.0 


True Logarithmic PCM (mid-tread) 


40 


16.0 


True Logarithmic PCM (mid-tread) 


64 


16.0 


15-Segment PCM (mid-riser) 


32 


37.7 


15-Segment PCM (mid-riser) 


48 


26.3 


15-Segment PCM (mid-tread) 


:(2 


16.0 


15-Segment PCM (mid-tread) 


41) 


16.0 


15-Segment PCM (mid-tread) 


48 


16.0 


15-Segment PCM (mid-tread) 


64 


16.0 


NIC PCM 


19 


31.4 


NIC PCM 


35 


19.6 


NIC PCM 


43 


16.0 


NIC PCM 


51 


16.0 


NIC PCM 


59 


16.0 


ADPCM (with step-size leak) 


16 


27.1 


ADPCM (with step-size leak) 


24 


23.1 


ADPCM (with step-size leak) 


32 


18.6 


ADPCM (with step-size leak) 


40 


18.4 


ADPCM (with step-size leak) 


48 


18.4 


ADPCM (without step-size leak) 


16 


25.2 


ADPCM (without step-size leak) 


24 


22.3 


ADPCM (without step-size leak) 


l!2 


18.7 


ADPCM (without step-size leak) 


48 


18.4 


SLC ADM 


24 


23.3 


SLC ADM 


37.7 


15.5 


SLC ADM 


48 


13.3 
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Fig. 7 — Subjective results — additive random noise. 
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Fig. 8 — Subjective results — single encodings vs line bit rate. 

channel noises of the higher bit rate codec conditions listed in Table III 
are in the range of 13.3 to 26.3 dBrnC. The 4.2-dB loss following the 
decoders translates this range into 9.1 to 22.1 dBrnC at the line terminals 
of the telephone set. As these tests were conducted in an acoustically 
shielded room, the noise results of Fig. 7 show that subjects can react to 
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Fig. 10 — Subjective results — line error rates. 

noise levels on the order of 10 dBrnC, since the curves do not level off 
in this vicinity. Thus, the leveling-off tendency in Fig. 8 is in line with 
the noise response curves of Fig. 7 for the lower values of noise. A second 
factor may be the distortion and bandlimiting introduced by the trans- 
mitting and receiving 500-type telephone set pair. 

Two other important observations can be extracted from Fig. 8. The 
first is that there appears to be no appreciable differences among the 
three versions of li255 PCM tested, at least for bit rates greater than 
32 kb/s. The other observation is that the introduction of step-size leak 
in the ADPCM algorithm (see Section 2.3) has a small effect on subjective 
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quality in the vicinity of 32 kb/s under these conditions. The intent here 
is not to determine the optimal amount of leak to be introduced but to 
demonstrate that leak can affect subjective quality. 

The results for the subjective ratings as a function of input level and 
received volume are shown in Fig. 9. The results are grouped according 
to a fixed received volume with a varying input level. The solid lines 
represent the preferred received volume of —29 VU with the dotted and 
dashed lines representing received volumes of -20.7 VU and —38.3 VU, 
respectively. The cluster of four points on the left-hand side of Fig. 9 
represents the —47.0 VU received volume where only one corresponding 
input level of —41.2 VU is used. Each curve is a response for a particular 
codec and is labeled accordingly. 

The MOS results in Fig. 9 are due to a combination of effects: 
(i) quantizing distortion, {ii) the received volume level that the subject 
hears at the telephone set, {Hi) the absolute level of idle channel noise 
at the set terminals which is a function of both the input level and receive 
volume, and {iu) overload distortion which is manifested as ampli- 
tude-limiting for PCM and NIC and slope overload for the ADPCM and 
SLC ADM codecs. All four of these effects must be considered collectively 
when interpreting these plots. With these caveats in mind, a few obser- 
vations can be made here with detailed analyses left to future studies. 

The NIC algorithm is rated significantly better than the PCM algorithm 
for nearly all input levels and received volumes. This is an expected re- 
sult, since the NIC codec readjusts its dynamic range for each block of 
eight samples. The amplitude overload point of both the PCM and NIC 
codecs for the speech sources in this study occurs at an input level of 
approximately —12.4 VU. Thus, the subjective ratings of PCM and NIC 
are the greatest for the input level of —10.5 VU, where only a small 
number of samples are clipped and the entire dynamic range is fully 
exercised. At the input level of —0.2 VU, the peaks of the speech are 
roughly 12 dB above overload and the MOS ratings fall off for PCM and 
NIC at both received volumes of -20.7 and -29 VU. 

The SLC ADM and ADPCM codecs hold up somewhat better for high 
input levels of speech, confirming that slope overload is "more" tolerable 
than amplitude overload. The ADPCM and SLC ADM codecs are rated 
comparably for the input levels of -10.5 and -20.7 VU. 

Two additional general observations can be inferred from Fig. 9. First, 
the set of curves for the received volume of —29 VU tends to have higher 
MOS ratings than the sets for received volumes of —20.7 and —38.3 VU. 
This can be attributed to three causes: (i) —29 VU is the preferred re- 
ceived volume, {ii) the dynamic ranges of the PCM and NIC codecs are 
exercised fully with essentially no overloading, and {Hi) the idle channel 
noises heard by the subjects are low because of the high input levels 
(0 to 4 dBrnC for the input level of -10.5 VU). These effects lead to 
higher MOS values than those shown for the same codecs in Fig. 8. The 
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second observation from Fig. 9 is that for the lowest received volume 
tested, -47.0 VU, the adaptive codecs are scored equivalently with PCM 
receiving an even lower rating due to its coarse quantization of the speech 
at the input level of -41.2 VU. 

The final portion of the single encoding testing is concerned with the 
effect of line error rates on the four codecs in Table IIC. The results are 
tabulated in Table VII and shown in Fig. 10, where MOS is plotted versus 
the errors per bit on a logarithmic scale. Note that the response curves 
converge at low (10~ 5 ) and high (10 _1 ) error rates. The 10 _1 rate is suf- 
ficiently severe so that the four codecs are all rated "unsatisfactory" and 
the 10~ 5 error rate is virtually undetectable, and the four codecs are rated 
"good." The leveling-off of the four curves for low error rates at MOS 
values of 4.2 to 4.5 is slightly higher than the asymptotic value in Fig. 
8. This is due to the fact that the input level of —12.4 VU and the corre- 
sponding receive value of —29 VU result in lower idle circuit noises as 
measured at the line terminals of the telephone set. 

Significant differences among the codecs are only manifested in the 
area between 10 -4 and 10 -2 errors per bit. The SLC codec is the least 
sensitive to line errors while PCM is the most sensitive. NIC and ADPCM 
(with step-size leak) are rated nearly the same and fall between the SLC 
ADM and PCM extremes. Although the ADPCM codec without step-size 
leak was not formally tested in the presence of errors, informal listening 
tests have shown that it is subjectively comparable to the PCM codec. 

VI. SUBJECTIVE TESTING— TANDEM ENCODINGS 
6.1 Test design 

This section contains a description of the tandem encoding conditions 
listed in Table IV. Basically, the four codec algorithms of the previous 
section are used here at a few selected bit rates, again because of the 
constraint of economizing on the total number of test conditions. Evi- 
dence from the single encoding versus line bit rate tests show that the 
adaptive codecs, NIC, ADPCM, and SLC ADM have a 12- to 16-kb/s ad- 
vantage over /i255 PCM for bit rates below 48 kb/s. Thus, it was decided 
to compare 48-kb/s //255 PCM against NIC, ADPCM, and SLC ADM in the 
vicinity of 32 kb/s. The 8-kHz sampling rate dictated that ADPCM and 
NIC operate at 32 and 35 kb/s, respectively. Since the SLC- 40 ADM al- 
gorithm is implemented in the loop plant today, the sampling rate of that 
system, 37.7 kb/s, is used. Finally, there is interest in the tandem per- 
formance of D channel banks, hence 64-kb/s /j.255 PCM is included as a 
reference. ADPCM is implemented without step-size leak since subjects 
did perceive some degradation for ADPCM with leak at 32 kb/s. 

The input speech level to the codecs is —20 VU, approximately the 
speech volume averaged over Bell System local and toll connections. 10 
The received volume is set at the preferred level of —29 VU. A tabulation 
of the tandem encoding conditions is given in Table IV. 
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Table IV — Tandem encoding conditions 





Bit Rate 


Number of 


Codec 


(kb/s) 


Tandem Encodings 


PCM 


64 


1,2,4,6,8 


PCM 


48 


1,2,4,8 


NIC PCM 


35 


1,2,4,8 


ADPCM 


32 


1,2,4,8 


SLC ™ADM 


37.7 


1,2,4,8 



To explain the tandem encoding process in more detail, two configu- 
rations are shown in Fig. 11 which are simply expansions of Fig. 2. The 
upper arrangement is applicable to the 8-kHz codecs, PCM, NIC, and 
ADPCM. The filtering used for bandlimiting and reconstruction is re- 
alized with transmit and receive filters with characteristics that are 
similar to those used in D3 channel banks. 12 Note that each time the 
tandem encoding loop is transversed, the filters encountered are a 
receive/transmit pair, analogous to a back-to-back D channel bank sit- 
uation. 

Tandem encodings of the 37.7-kb/s SLC-40 ADM are generated in a 
slightly different manner, as shown in the lower portion of Fig. 11. 
Specifically, the differences are manifested in the filtering. The SLC 
input and output filters, which are implemented in software, in con- 
junction with a 6.4-kHz low-pass filter provide sufficient rejection at half 
the 37.7-kHz sampling rate to avoid aliasing. After the desired number 
of tandem encodings have been simulated, a D channel bank transmit 
filter is inserted in the playback path prior to recording so that small 
bandwidth differences between the 8-kHz and 37.7-kHz SLC ADM 
conditions are eliminated. 

The use of these two filtering strategies results in different in-band 
characteristics as illustrated in Figs. 12 and 13, where the overall re- 
sponses for a single encoding and eight tandem encodings are given for 
the 8-kHz and the 37.7-kHz SLC ADM codecs, respectively. 

6.2 Results and observations 

The tandem encoding MOS results and the breakdown according to 
comment category are tabulated in Table VIII of the appendix. 

These results are shown in Fig. 14, where the MOS ratings are plotted 
as a function of the number of tandem encodings. An immediate obser- 
vation is the superiority of the 64-kb/s /*255 PCM over the other four 
codecs. This superiority is evidenced by the facts that the response curve 
for 64-kb/s PCM begins to fall off at four encodings while the responses 
for the other four codecs fall off at two encodings, and eight encodings 
of 64-kb/s PCM is rated slightly below a MOS of 4 ("good"), while eight 
encodings of the other codecs are rated between 3 ("fair") and 2 ("poor"). 
Even for eight encodings of 64-kb/s ^255 PCM, the degradation is not 
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Fig. 12 — Overall frequency response — 8 kHz — one and eight encodings. 

attributable only to quantizing noise. Accumulation of the idle channel 
noise and bandwidth reduction of the tandem filtering are other fac- 
tors. 

Another general observation is that, to a rough approximation, the 
three adaptive codecs (35-kb/s NIC, 32-kb/s ADPCM, and 37.7-kb/s SLC 
ADM) behave in a similar fashion to 48-kb/s PCM. This result concurs 
with the single encoding results of Fig. 8 where it was shown that the 
adaptive codecs exhibited a 12- to 16-kb/s subjective advantage over 
PCM. 

Finally, all the curves in Fig. 14 at one encoding agree well with the 
single encoding results of Fig. 8 after it is recognized that the input level 
here is 4.8 dB greater than that of the single encoding tests. Both the 
single encoding versus line bit rate and tandem encoding tests were 
conducted at the received volume of —29 VU. Thus, the higher input level 
in the tandem encoding tests results in a 4.8-dB reduction in the idle 
channel noises heard by the subjects. 
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VII. SUBJECTIVE TESTING— REFERENCE CONNECTIONS 

The purpose of the reference connection conditions is to evaluate the 
codecs of the previous section in representative network connections. 
Basically, these reference connections are of three types: local, exchange, 
and toll. The codecs are placed in connections where the environment 
in terms of speech volume, analog loss, and analog noise is defined from 
survey data. The received volumes are not held constant, but vary de- 
pending on the loss in the connection. For all connections, the codec 
characteristics such as overload and idle channel noise are defined in 
Section II. The connections are chosen in such a manner that average 
and worst-case situations are represented. 

Many reference connections involve similar and dissimilar tandem 
encodings. Prior to a detailed description of the different connections, 
a few words on the analog interface between successive encodings are 
appropriate. The four codecs can be grouped into two categories deter- 
mined by whether the sampling rate is 8 kHz or 37.7 kHz. This leads to 
four possible combinations in simulating a tandem encoding because 
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Fig. 14 — Subjective results — tandem encodings. 

of the filtering that is necessary. These four configurations are shown 
in Fig. 15. The top and bottom are identical to those shown in Fig. 11 
since the sampling rates of the two codecs are the same. The two center 
arrangements in Fig. 15 are the cases where an 8-kHz and 37.7-kHz codec 
are both involved. Here the D channel bank transmit and receive filters 
are utilized with the SLC input and output filters. These four arrange- 
ments apply to the remainder of the discussions on reference connec- 
tions. 

7.1 Test design 

7. 1. 1 Local reference connections 

The local connection conditions are configured as shown in Fig. 16. 
There are four types of connections, depending on the presence of codecs 
in the loops: (i) near- and far-end loops, both analog, (ii) codec in near- 
end loop, (Hi) codec in far-end loop, and (iv) codec in both loops. Note 
that an average loop loss of 3.7 dB 13 is assumed regardless of the presence 
or absence of a codec. It is recognized that this assumption may be in- 
appropriate when a codec is present, since the loop loss might be reduced. 
However, this loss is fixed to avoid confounding the subjective effect of 
loss variation with that of introducing a codec in the loop. The input 
speech volume is chosen to be the average found for local calls, 
—24.8 VU. 10 The assumed loop loss of 3.7 dB translates this into a re- 
ceived volume of about -28.5 VU. 

The central office is modeled as either an analog switch or a 64-kb/s 
/i255 PCM digital switch. When the office is analog, 16 dBrnC of random 
noise is added to the speech as it traverses the office. This noise value 
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Fig. 15 — Dissimilar tandem encoding configuration. 

is chosen to correspond to the digital switch where 16 dBrnC is added 
after the PCM decoder, as described in Section 2.1. In the context of this 
local environment, the local reference connection conditions to be sub- 
jectively evaluated are listed in Fig. 21. In the conditions with a codec 
in both loops, the two codecs may be either identical or dissimilar. For 
the case of two dissimilar codecs, the subjective effect of ordering is in- 
vestigated by including conditions where the physical locations of the 
codecs are interchanged. 

7. 1.2 Exchange reference connections 

The exchange reference connection model is shown in Fig. 17. This 
model is a simple extension of the local connection model in that an 
additional central office is connected to the first office via a direct trunk. 
The central offices and loops, whether analog or digital, are modeled as 
in the local reference connections. 
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64 kb/sec PCM 
48 kb/sec PCM 
35 kb/sec NIC 
32 kb/sec ADPCM 
37.7 kb/sec SLC" 



•64 kb/sec ^255 PCM DIGITAL CENTRAL OFFICE 

Fig. 16 — Local reference connections. 



The direct trunk facility between the central offices is either analog 
or digital. The loss used in both cases is 3 dB. In addition, 14.8 dBrnC 
of noise derived from survey data is introduced on the analog trunk. On 
the digital direct trunk, the noise introduced is the characteristic idle 
channel noise of the codec. The speech volume in both situations is 
—23.1 VU, 10 slightly higher than that found on the local reference con- 
nections. 

To keep the number of conditions down to a mangeable level, codecs 
are introduced into the exchange connection in only one manner. If a 
codec is to appear in the connection, it must appear in all three compo- 
nents of connection simultaneously — both loops and the direct trunk. 
Furthermore, the three codecs must be identical; a mixture of different 
codecs is not allowed. Using these rules, the exchange reference con- 
nection conditions are formulated and tabulated in Fig. 22. 

When both central offices are digital (64-kb/s ju255 PCM) and the co- 
decs in the loops and direct trunk are either PCM or NIC, only a trivial 
code conversion is needed between the office and loop or trunk. The 3-dB 
direct trunk loss can be included in the far-end loop loss, and the entire 
connection collapses into a single encoding. For the case of the three 
ADPCM codecs, the analog link between the codec and digital central 
office can also be eliminated. All that is necessary is an intermediate D/D 
conversion to uniform PCM. Thus, the entire connection is digital where 
the 3-dB loss is a digital loss and is introduced where it is depicted in Fig. 
17. 
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7. 1.3 Toll reference connections 

The toll reference connections are arrived at using the diagram in 
Fig. 18. Essentially, this diagram differs from Fig. 17 in that the direct 
trunks are replaced with the toll network wherein a connection comprises 
two toll-connecting trunks and one or more intertoll trunks. The toll 
network is assumed to be implemented on analog and digital facilities 
where "digital" implies only 64-kb/s /u255 PCM-No. 4 ESS switches, VIF 
terminals, and D channel banks. 1 The codecs described in the previous 
two sections will only be modeled in loops on the ends of the toll con- 
nection. Thus, a toll reference connection consists of two loops where 
a codec may appear and toll trunks with various mixtures of analog and 
digital 64-kb/s ^255 PCM facilities. 

The local portion of Fig. 18 is similar to that in the local and exchange 
reference connections with the following exceptions. To limit the total 
number of test conditions, only the analog version of the central office 
is configured in toll connections. As before, a 16-dBrnC noise source is 




64 kb/sec PCM 

48 kb/sec PCM 

:; H 35 kb/sec NIC 

32 kb/sec ADPCM 
37.7 kb/sec SLC™ 



Fig. 18 — Toll connection diagram. 
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incorporated in the central office model. The average speech volume used 
in the toll reference connections is significantly higher than that found 
in local and exchange connections and was found by McAdoo to be 
—16.8 VU. 10 Finally, when two codecs are simultaneously introduced in 
both loops on a particular connection, both codecs are always identi- 
cal. 

Four types of toll connections are considered here: (i) short, (ii) long, 
(Hi) "worst-case" long, and (iu) all-digital. The short and long toll con- 
nections are further divided into three subcategories according to facility 
makeup: (a) analog switches and analog transmission facilities, (b) analog 
switches and digital transmission facilities, and (c) digital switches and 
analog transmission facilities. The "worst-case" long connection is simply 
derived from the long toll connection by the introduction of additional 
intertoll trunks. The all-digital connection consists of a single 64-kb/s 
^255 PCM encoding in the toll network with the speech in digital form 
between the transmit and receive central offices. 

The toll reference connections are now described, using Fig. 19. 

(i) Short Toll Connections— The analog connection Si consists of 
two toll connecting trunks and a single short intertoll trunk. The toll 
connecting trunks are characterized by a VNL loss of 3 dB and an average 
survey noise source of 11.3 dBrnC. 14 The 60-mile intertoll trunk has a 
VNL design loss of 0.5 dB and a projected noise of 20.4 dBrnC. 11 The 
analog toll switches are assumed to add noise in an amount equivalent 
to 12 dBrnC. These characterizations of analog transmission and 
switching facilities will apply to all the toll connections discussed from 
this point on. 

The center configuration, S 2 , is a modification of Si where the analog 
toll switches are replaced with No. 4 ESS switches and VIF terminals. The 
VIF terminal involves a 64-kb/s ^255 PCM encoding and decoding fol- 
lowed by a 16-dBrnCO noise source as described in Section 2.1. This 
translates into 13 dBrnC at the -3 TLP point for the speech with the 
codec overload set at +3 dBmO. 

The bottom configuration, S 3 , is another modification of Si with digital 
transmission facilities and analog switches. All three trunks are analog 
trunks, and VNL loss design applies. However, the noise sources on the 
toll-connecting and intertoll trunks have been replaced with the ap- 
propriate idle channel noises at the decoder side of the D channel 
banks. 

(ii) Long Toll Connections — Referring to configuration Li in the 
diagram, the toll-connecting portion is identical to that of the short 
connection. The intertoll section consists of two intertoll trunks, a short 
(48 mi.) and a long (1300 mi.) one. The short trunk has loss and noise 
characteristics similar to the intertoll trunk in the short connection 
described above. Using VNL design and survey data, the long intertoll 
trunk has a loss of 2.0 dB and a noise of 37.8 dBrnC. 

SELECTED DIGITAL CODECS FOR SPEECH 3147 



S, -ALL ANALOG 



16dBrnC 



11.3dBrnC 




20.4dBrnC 12dBrnC 11.3dBrnC 16dBrnC 



i s~~~*\ 05dB Jt 

W--Vvvv-0 

V_>^ 60 mi. 




-2TLP 



S, - DIGITAL SWITCHES + ANALOG TRANSMISSION 



16dBrnC 


11.3dBrnC 
/ 
1 


*>. 3dB 





OTLP 



13dBrnC 19.6dBrnC 




-3TLP 



13dBmC 11.3dBrnC 16dBmC 

\ 




S 3 - ANALOG SWITCHES + DIGITAL TRANSMISSION 

16dBrnC 16 dBrnC 12dBrnC 

/ 
/ 



14dBrnC 16dBrnC 
/ 




OTLP 



2 TLP 



V = VOICEBAND INTERFACE FRAME 
D= D CHANNEL BANK 

Fig. 19— Toll reference connections, (a) Short toll connections. (Figs 19b and 19c on 
following pages. ) 

Configuration Li is modified in a manner identical to that described 
above for the short toll connection to produce the mixed analog and 
digital connections, L2, and L 3 . Of significant interest here is the re- 
duction of noise with the deployment of digital transmission facilities 
in configuration L3. It is expected that this reduction in noise will 
manifest itself subjectively. 

(Hi) Worst-Case Long Toll Connection — This condition is dubbed 
"worst case" for two reasons. First, it is constructed from L2 of the long 
toll connections by the addition of three intertoll trunks for a total of 
five intertoll trunks. Network statistics show that a small percentage of 
toll connections are made over five intertoll trunks. Second, the No. 4 
ESS with analog transmission facilities type of connection contains not 
only all the analog impairments such as loss and noise but also the 
64-kb/s m255 PCM encodings. In this connection, there are a total of six 
PCM encodings in the toll portion and also codecs in the loops. 

(iu) All-Digital Toll Connection — This connection is the simplest 
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Fig. 19(c) — Worst-case and all-digit toll connections. 



of the toll connections in that the toll network (switches and trunks) is 
purely digital. Hence, the toll network can be modeled by a single 64-kb/s 
ju255 PCM encoding implemented on a D channel bank on each toll- 
connecting trunk and a fixed 6-dB loss at the receiving central office. 
The ju255 PCM at 48 and 64 kb/s, 35-kb/s NIC, 32-kb/s ADPCM, and 
37.7-kb/s SLC ADM codecs are incorporated in the loops on the eight 
toll connections described above. 

7.2 Results and observations 

Detailed tabulations of the MOS ratings for the local, exchange, and 
toll reference connection conditions are given in Tables IX through XII 
in the appendix. A cumulative comparison of the analog noise ratings 
is plotted in Fig. 20, where the single encoding noise results are plotted 
along with the tandem encoding and reference connection results to il- 
lustrate a comparison across all the blocks of testing. 
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NOISE AT TELEPHONE SET TERMINALS (dBrnC) 

Fig. 20— Subjective results — additive random noise. 

7.2. 1 Local reference connections 

The local reference connection results are summarized in Fig. 21. In 
this figure, the connections of Fig. 16 are redrawn to aid the reader in 
associating the connection with the results. The top configuration of Fig. 
21 is the analog version of the connection where the only impairment 
introduced in the speech is the noise of the analog central office. This 
amounts to 12.3 dBrnC of noise with a speech level of —28.5 VU at the 
telephone set terminals. This condition is rated with a MOS of 4.0 and 
is in agreement with the noise results shown in Fig. 20. 

The second configuration represents the digital central office case 
using 64-kb/s m255 PCM. As described in Section 2.1, 16 dBrnC of noise 
is introduced into the speech following the decoder so that the speech 
level and idle channel noise at the line terminals of the telephone set are 
identical to those of the analog connection above it. The MOS of this 
connection is 4.0 and it is concluded that the 64-kb/s PCM office intro- 
duces no additional subjective distortion. 

The bottom configuration in Fig. 21 is used to represent all possible 
combinations of codecs in the loops. The table directly beneath it gives 
the MOS ratings for three cases: (i) codec in the transmit loop with an 
analog receive loop, (w) codec in the receive loop with an analog transmit 
loop, and (Hi) codecs in both loops. The first two columns are essentially 
single encodings with the addition of the 16-dBrnC office noise. These 
results are in agreement with the single encoding results of Section 5.2. 
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Fig. 21 — Subjective results — local reference connections. 

The third column represents two codecs in tandem with the addition of 
the office noise. It is observed that a second 64-kb/s ^255 PCM encoding 
does not introduce any additional degradation, while the MOS ratings 
for the other four codecs are slightly lower than those for the case of a 
single codec in one loop of the connection. This result is in agreement 
with the tandem encoding results discussed in Section 6.2. 

The bottom table in Fig. 21 is a matrix of the results for mixed tandem 
encodings, that is, there are codecs in both loops but they are dissimilar. 
Reversal of the ordering of any pair of codecs is indicated by inter- 
changing the row and column indices for any element in the matrix. A 
comparison of the elements in the upper and lower triangular portions 
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of the matrix leads to the following conclusions: (i) the subjective per- 
formance of a tandem encoding involving 64-kb/s PCM and one of the 
four lower bit rate codecs is roughly equivalent to a single encoding of 
the lower bit rate codec, and («) the subjective effects of ordering in 
dissimilar tandem encodings are small for the five codecs discussed 
here. 

7.2.2 Exchange reference connections 

The exchange reference connection results are shown in Fig. 22. In 
keeping with the format of the local reference connections, the top 
configuration in Fig. 22 represents the all-analog exchange connection. 
Here, 19.5 dBrnC of noise appears with the -29.8 VU speech at the 
telephone set terminals and is rated with a MOS of 3.6 by the subjects. 
The second connection in Fig. 22 is identical to the analog connection 
except that three identical codecs are introduced in the exchange trunk 
and both loops. Note that the 14.8-dBrnC noise on the analog exchange 
trunk is effectively replaced by the idle channel noise of the codec. The 
table immediately below this connection lists the MOS results for the five 
codecs. The introduction of the three 64-kb/s PCM codecs does not alter 
the MOS rating over that of the analog connection. However, three en- 
codings of one of the other four codecs degrades the connection some- 
what. 

The last configuration in Fig. 22 is a modification of the second con- 
figuration which is realized by replacing both analog central offices with 
digital central offices. As explained in Section 7.1, the resulting con- 
nection can be represented as either a single encoding, a series of syn- 
chronous tandem encodings with intermediate D/D conversions, or a 
series of asynchronous encodings with intermediate analog links, de- 
pending on code compatibility between the 64-kb/s PCM central offices 
and the codecs on the loops and exchange trunk. For 64-kb/s PCM, 48- 
kb/s PCM, and 35-kb/s NIC, the connection from the encoder of the 
transmit codec to the decoder of the receive codec collapses into a single 
encoding. The 3-dB exchange trunk loss is incorporated in the loop loss 
following the decoder. Thus, the first three entries in the table under this 
connection represent single encodings of these codecs. Consequently, 
the reduction of noise over the all-analog connection results in MOS 
ratings higher than the analog connection rating of 3.6. In the case of 
ADPCM, the successive encodings are performed synchronously with 
a corresponding reduction in noise, and the connection is rated nearly 
equivalent to the analog connection. The final entry for the SLC ADM 
codec is virtually identical to the analog central office case because all 
the noise sources are unchanged and the tandem encodings are per- 
formed asynchronously with the analog central offices replaced by 
64-kb/s PCM digital central offices. 
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7.2.3 Toll reference connections 

The final portion of the subjective testing is concerned with the effects 
of codecs in toll reference connections. The codecs are placed in loops 
on the ends of the eight toll connections of Fig. 19. This is accomplished 
in two steps. The first step is the placing of a codec in the receive loop 
only and, in the second step, identical codecs are placed in both loops. 

Figure 23 displays the results for a codec in the receive loop only. The 
results for the longer toll connections on which 37.8-dBrnC of noise 
appears demonstrate that the noise is the dominant impairment and the 
effects of the codecs are of little importance (see connections Li, L2, and 
W). The MOS ratings of these connections are tightly grouped in the area 
of a MOS of 3 ("fair"), indicating that the subjects are reacting only to 
the noise source. Note that the noises on the intertoll trunks translate 
to approximately 31 dBrnC of noise at the line terminals of the telephone 
set for these three connections. A check with the noise results of Fig. 20 
indicates agreement. It is also observed that in toll connection L3, the 
37.8-dBrnC noise is eliminated because of the deployment of digital 
transmission systems on the intertoll trunks. This shifts the MOS ratings 
upward in line with those obtained for the short (Si, S2, S3) and all-digital 
(D) connections. 

The toll connections which received the higher subjective scores (Si, 
S2, S3, Lg, and D) show that, if the quality of the connection is good, 
subjects can discriminate among the five codecs and the MOS ratings are 
spread out over a point or so. However, it is observed that, even though 
the discrimination between one codec and the next may be small, on most 
connections the 64-kb/s PCM codec case is rated nearly equivalent to the 
case where both loops are analog. Also, a comparison of connections Si 
versus S2 and Li versus L 2 with both loops analog serves to demonstrate 
that the addition of 64-kb/s PCM codecs in the analog toll portion of the 
connection does not significantly alter the subjective performance of the 
connection. 
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Fig. 23 — Subjective results — toll reference connections. 
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The introduction of codecs in both loops of the toll connections results 
in the ratings of Fig. 24. Many of the observations for Fig. 23 apply here 
with minor modification. The toll connections of Li, L2, and W are rated 
the same with codecs in both loops when compared to the results for a 
codec in the receive loop only. In nearly all of the connections, the 64-kb/s 
PCM and analog loop cases again receive nearly equivalent ratings. The 
only differences between the results of Figs. 23 and 24 are those for 
connections with the higher ratings (Si, S2, S3, L3, and D). Here the 
spread among the MOS results for the lower bit rate codecs has increased 
because codecs are introduced in both loops. This indicates that subjects 
can perceive an additional degradation for two encodings of the lower 
bit rate codecs over a single encoding, a result already demonstrated in 
the tandem encoding results of Section 6.2. 

VIII. CONCLUSIONS 

Several important conclusions can be drawn from the results presented 
in this paper for speech: 

(i) The 64-kb/s /i255 PCM codec can be used, with very few restric- 
tions, in the telephone network without affecting speech performance. 
It can be tandemed up to eight times without introducing serious sub- 
jective degradation. It can be inserted in a variety of analog network 
connections with essentially no subjective penalty. However, it is shown 
that eight encodings of either 48-kb/s fi255 PCM, 35-kb/s NIC, 32-kb/s 
ADPCM, or 37.7-kb/s SLC ADM introduce significant subjective degra- 
dations. 
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Fig. 24 — Subjective results — toll reference connections. 
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This conclusion supports the general application of the 64-kb/s ,u255 
PCM in the combined analog and digital network which is likely to exist 
for many years to come. The use of codecs with lower bit rates would 
require more stringent application rules to avoid excessive degradation 
in tandem arrangements. 

(ii) The 10 -6 error rate minor alarm level for the toll switched digital 
network, 1 which uses 64-kb/s ^255 PCM, is more than adequate for speech 
since the results of this study show that the subjective degradation at 
a 10~ 5 error rate is negligible. In other words, if error rates could be 
guaranteed to never exceed 10 -6 errors/bit, then error rate would not 
be a consideration for the four 48-kb/s codecs tested. 

(Hi) Connection degradation is dominated by high levels of random 
noise that may be found on long toll connections. However, the 64-kb/s 
At255 PCM all-digital toll connection shows that the network performance 
will improve as the network becomes increasingly digital. As the network 
evolves, the performance should not be unduly limited by the choice of 
codec deployed in the loops. 

(iu) For single encodings, the results show that the three adaptive 
coding schemes (NIC, ADPCM, and SLC ADM) have about a 12- to 16-kb/s 
advantage over ^255 PCM for equivalent subjective ratings. This ad- 
vantage can also be inferred from the tandem encoding and reference 
connection results where 48-kb/s PCM has approximately the same rating 
as 35-kb/s NIC, 32-kb/s ADPCM, and 37.7-kb/s SLC ADM. 

(u) At 48-kb/s, the level variation and error rate tests demonstrate 
that the three adaptive codecs are slightly superior to PCM under these 
conditions. 

(vi) For the three adaptive coding algorithms (NIC, ADPCM, and SLC 
ADM), no single algorithm is significantly superior to the other two on 
an overall basis. All three perform comparably, with small variations over 
the range of conditions tested. 
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APPENDIX 

Table V — Detailed tabulation of subjective scoring 
for single encoding vs line bit rate tests 





Bit Rate 




% 


% 


% 


% 


% 






Codec 


(kb/s) 


Votes 


Exc 


Good 


Fair 


Poor 


Uns. 


MOS 


a 


PCM 


32 


102 


0.0 


1.0 


31.4 


54.9 


12.8 


2.2 


0.66 


PCM 


40 


102 


2.0 


20.6 


56.9 


18.6 


2.0 


3.0 


0.74 


PCM 


48 


102 


15.7 


47.1 


32.4 


4.9 


0.0 


3.7 


0.78 


PCM 


64 


101 


35.6 


49.5 


14.9 


0.0 


0.0 


4.2 


0.68 


PCMi 


32 


102 


0.0 


2.0 


30.4 


62.8 


4.9 


2.3 


0.59 


PCMi 


48 


101 


4.0 


43.6 


42.6 


9.9 


0.0 


3.4 


0.72 


PCM2 


16 


102 


0.0 


0.0 


0.0 


6.9 


93.1 


1.1 


0.25 


PCM2 


40 


101 


3.0 


25.7 


48.5 


22.8 


0.0 


3.1 


0.77 


PCM 2 


64 


102 


30.4 


53.9 


15.7 


0.0 


0.0 


4.2 


0.66 


NIC 


19 


100 


0.0 


1.0 


27.0 


49.0 


23.0 


2.1 


0.73 


NIC 


35 


102 


10.8 


38.2 


43.1 


7.8 


0.0 


3.5 


0.79 


NIC 


43 


101 


22.8 


58.4 


18.8 


0.0 


0.0 


4.0 


0.64 


NIC 


51 


101 


30.7 


54.5 


13.9 


1.0 


0.0 


4.2 


0.68 


NIC 


59 


101 


33.7 


53.5 


10.9 


2.0 


0.0 


4.2 


0.70 


ADPCM 


32 


101 


19.8 


41.6 


36.6 


2.0 


0.0 


3.8 


0.77 


ADPCM 


48 


102 


31.4 


50.0 


17.6 


1.0 


0.0 


4.1 


0.72 


ADPCM i 


16 


101 


0.0 


0.0 


12.9 


61.4 


25.7 


1.9 


0.61 


ADPCMi 


24 


102 


1.0 


9.8 


51.0 


38.2 


0.0 


2.7 


0.67 


ADPCM i 


32 


102 


3.9 


37.3 


51.0 


6.7 


1.0 


3.4 


0.71 


ADPCMi 


40 


101 


19.8 


48.5 


26.7 


5.0 


0.0 


3.8 


0.80 


ADPCMi 


48 


102 


30.4 


55.9 


12.8 


1.0 


0.0 


4.2 


0.67 


SLC™ 


24 


102 


2.0 


20.6 


57.8 


18.6 


1.0 


3.0 


0.71 


SLC 


37.7 


101 


11.9 


46.5 


36.6 


5.0 


0.0 


3.7 


0.75 


SLC 


48 


102 


29.4 


51.0 


15.7 


3.9 


0.0 


4.1 


0.78 


Noise 10 dBrnC 


203 


34.0 


47.3 


17.2 


1.5 


0.0 


4.1 


0.74 


Noise 20 dBrnC 


204 


9.8 


30.9 


51.5 


7.8 


0.0 


3.4 


0.77 


Noise 30 dBrnC 


203 


1.5 


15.3 


46.8 


35.0 


1.5 


2.8 


0.76 


Noise 40 dBrnC 


203 


1.5 


3.5 


26.6 


54.2 


14.3 


2.2 


0.79 


Q- 


-5dB 


203 


0.0 


0.0 


0.0 


32.0 


68.0 


1.3 


0.47 


Q- 


10 dB 


204 


0.0 


0.5 


18.1 


54.4 


27.0 


1.9 


0.68 


Q- 


15 dB 


204 


0.0 


10.3 


48.5 


35.8 


5.4 


2.6 


0.74 


Q- 


20 dB 


203 


2.0 


32.0 


53.2 


12.8 


0.0 


3.2 


0.69 


Q- 


25 dB 


203 


23.2 


50.3 


25.1 


1.5 


0.0 


4.0 


0.73 



Notation: 

PCM = 15-segment PCM (mid-tread) 
PCMi = 15-segment PCM (mid-riser) 
PCM2 = continuous law PCM (mid-tread) 
NIC = NIC PCM 

ADPCM = ADPCM (without step-size leak) 
ADPCMi = ADPCM (with step-size leak) 
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Table VI — Detailed tabulation of subjective scoring 




for single encoding ' 


vs level variation tests 












% 


% 


% 


% 


% 






Codec 


Levels 


Votes 


Exc. 


Good 


Fair 


Poor 


Uns. 


MOS 


a 


PCM 


Ii.Ri 


51 


5.9 


31.4 


41.2 


19.6 


2.0 


3.2 


0.89 


PCM 


I1.R2 


51 


5.9 


25.5 


52.9 


15.7 


0.0 


3.2 


0.77 


PCM 


I 2 ,Ri 


51 


33.3 


37.3 


19.6 


9.8 


0.0 


3.9 


0.96 


PCM 


I2.R-2 


51 


45.1 


43.1 


11.8 


0.0 


0.0 


4.3 


0.68 


PCM 


L2.R3 


51 


13.7 


43.1 


39.2 


3.9 


0.0 


3.7 


0.76 


PCM 


I31R2 


51 


19.6 


54.9 


25.5 


0.0 


0.0 


3.9 


0.67 


PCM 


I3.R3 


51 


17.7 


43.1 


37.3 


2.0 


0.0 


3.8 


0.76 


PCM 


l4,R 3 


51 


0.0 


41.2 


56.9 


2.0 


0.0 


3.4 


0.53 


PCM 


I5,R 4 


51 


0.0 


2.0 


31.4 


52.9 


13.7 


2.2 


0.69 


NIC 


Ii.Ri 


51 


15.7 


49.0 


31.4 


3.9 


0.0 


3.8 


0.76 


NIC 


Ii,R 2 


51 


5.9 


25.5 


47.1 


21.6 


0.0 


3.2 


0.83 


NIC 


l 2 ,Ri 


50 


34.0 


38.0 


24.0 


4.0 


0.0 


4.0 


0.86 


NIC 


I2.R2 


51 


54.9 


41.2 


3.9 


0.0 


0.0 


4.5 


0.57 


NIC 


I2.R3 


51 


27.5 


47.1 


25.5 


0.0 


0.0 


4.0 


0.73 


NIC 


I3.R2 


51 


27.5 


70.6 


2.0 


0.0 


0.0 


4.3 


0.48 


NIC 


I31R3 


51 


35.3 


35.3 


29.4 


0.0 


0.0 


4.1 


0.80 


NIC 


I 4 ,R3 


51 


21.6 


41.2 


33.3 


3.9 


0.0 


3.8 


0.82 


NIC 


Is>R4 


51 


2.0 


7.8 


54.9 


33.3 


2.0 


2.8 


0.71 


ADPCM 


Ii,Ri 


51 


33.3 


43.1 


15.7 


7.8 


0.0 


4.0 


0.90 


ADPCM 


Ii,R 2 


50 


18.0 


46.0 


28.0 


8.0 


0.0 


3.7 


0.84 


ADPCM 


I 2 ,Ri 


51 


31.4 


43.1 


19.6 


3.9 


2.0 


4.0 


0.92 


ADPCM 


I2.R2 


51 


35.3 


52.9 


11.8 


0.0 


0.0 


4.2 


0.64 


ADPCM 


I2.R3 


50 


4.0 


38.0 


48.0 


10.0 


0.0 


3.4 


0.71 


ADPCM 


I31R2 


50 


34.0 


40.0 


14.0 


12.0 


0.0 


4.0 


0.98 


ADPCM 


I3.R3 


51 


11.8 


41.2 


39.2 


7.8 


0.0 


3.6 


0.80 


ADPCM 


I4,R 3 


51 


15.7 


45.1 


39.2 


0.0 


0.0 


3.8 


0.70 


ADPCM 


I5.R4 


51 


0.0 


15.7 


49.0 


31.4 


3.9 


2.8 


0.76 


SLC m 


I1.R1 


51 


17.7 


37.3 


35.3 


9.8 


0.0 


3.6 


0.88 


SLC 


Ii,R 2 


50 


16.0 


36.0 


42.0 


6.0 


0.0 


3.6 


0.82 


SLC 


I 2 ,Ri 


51 


43.1 


31.4 


15.7 


9.8 


0.0 


4.1 


0.99 


SLC 


I2.R2 


51 


21.6 


54.9 


23.5 


0.0 


0.0 


4.0 


0.67 


SLC 


I2.R3 


51 


19.6 


47.1 


29.4 


3.9 


0.0 


3.8 


0.78 


SLC 


I3>R2 


50 


34.0 


52.0 


14.0 


0.0 


0.0 


4.2 


0.66 


SLC 


I31R3 


51 


7.8 


43.1 


37.3 


11.8 


0.0 


3.5 


0.80 


SLC 


l4,R 3 


51 


3.9 


7.8 


60.8 


27.5 


0.0 


2.9 


0.70 


SLC 


I 5 ,R4 


50 


0.0 


18.0 


42.0 


40.0 


0.0 


2.8 


0.73 


Noise 10 dBrnC 


Ri 


51 


23.5 


39.2 


27.5 


7.8 


2.0 


3.8 


0.97 


Noise 10 dBrnC 


R 3 


51 


5.9 


60.8 


25.5 


7.8 


0.0 


3.7 


0.71 


Noise 10 dBrnC 


R 4 


51 


3.9 


9.8 


43.1 


43.1 


0.0 


2.8 


0.79 


Noise 20 dBrnC 


Ri 


51 


3.9 


29.4 


52.9 


11.8 


2.0 


3.2 


0.77 


Noise 20 dBrnC 


R 3 


51 


17.7 


54.9 


27.5 


0.0 


0.0 


3.9 


0.66 


Noise 20 dBrnC 


R-, 


51 


0.0 


5.9 


47.1 


47.1 


0.0 


2.6 


0.60 


Noise 30 dBrnC 


Ri 


51 


3.9 


11.8 


43.1 


37.3 


3.9 


2.8 


0.86 


Noise 30 dBrnC 


R 3 


51 


0.0 


15.7 


56.9 


27.5 


0.0 


2.9 


0.65 


Noise 30 dBrnC 


R 4 


51 


2.0 


2.0 


25.5 


64.7 


5.9 


2.3 


0.69 


Noise 40 dBrnC 


Ri 


51 


0.0 


5.9 


25.5 


41.2 


27.5 


2.1 


0.87 


Noise 40 dBrnC 


R 3 


51 


0.0 


0.0 


23.5 


58.8 


17.6 


2.1 


0.64 


Noise 40 dBrnC 


R 4 


51 


2.0 


2.0 


11.8 


66.7 


17.6 


2.0 


0.74 


Q— 5dB 


Ri 


51 


0.0 


0.0 


5.9 


19.6 


74.5 


1.3 


0.58 


Q— 5dB 


R 3 


51 


0.0 


0.0 


0.0 


27.5 


72.5 


1.3 


0.45 


Q— 5dB 


R 4 


51 


0.0 


0.0 


0.0 


15.7 


84.3 


1.2 


0.36 


Q— 10 dB 


Ri 


51 


0.0 


2.0 


9.8 


49.0 


39.2 


1.8 


0.71 


Q— 10 dB 


Ra 


51 


0.0 


0.0 


11.8 


62.7 


25.5 


1.9 


0.59 


Q— 10 dB 


R4 


51 


0.0 


0.0 


2.0 


54.9 


43.1 


1.6 


0.53 


Q— 15 dB 


Ri 


51 


9.8 


7.8 


51.0 


29.4 


2.0 


2.9 


0.92 


Q— 15 dB 


R 3 


51 


0.0 


3.9 


49.0 


47.1 


0.0 


2.6 


0.57 


Q— 15 dB 


R 4 


51 


0.0 


5.9 


7.8 


70.6 


15.7 


2.0 


0.68 


Q— 20 dB 


Ri 


51 


15.7 


35.3 


41.2 


7.8 


0.0 


3.6 


0.84 


Q— 20 dB 


R:< 


51 


3.9 


23.5 


54.9 


17.6 


0.0 


3.1 


0.74 








(continued) 
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Table VI (cont) 










Q— 20 dB 


R 4 


51 


0.0 3.9 37.3 


52.9 


5.9 


2.4 


0.66 


Q— 25 dB 


Ri 


50 


32.0 34.0 26.0 


8.0 


0.0 


3.9 


0.94 


Q— 25 dB 


R 3 


51 


7.8 39.2 39.2 


13.7 


0.0 


3.4 


0.82 


Q— 25 dB 


R 4 


51 


9.8 13.7 43.1 


27.5 


5.9 


2.9 


1.02 



Notation: 

PCM = 48-kb/s 15-segment PCM (mid-tread) 

NIC = 51-kb/s NIC PCM 

ADPCM = 48-kb/s ADPCM (with step-size leak) 

SLC = 48-kb/s SLC ADM 

lb I2, I3, I4, and I 5 = input levels of -0.2, -10.5, -20.7, -31.0, and -41.2 VU, respec- 
tively 

Ri, R 2 , R3, and R 4 = received volumes of -20.7, -29.0, -38.3, and -47.0 VU, respec- 
tively 

Table VII — Detailed tabulation of subjective scoring 
for single encoding vs error rate tests 





Error 




% 


% 


% 


% 


% 






Codec 


Rate 


Votes 


Exc. 


Good 


Fair 


Poor 


Uns. 


MOS 


a 


PCM 


10-1 


207 


0.0 


0.0 


0.0 


3.4 


96.6 


1.0 


0.18 


PCM 


lO" 2 


204 


0.0 


2.0 


8.3 


63.2 


26.5 


1.9 


0.64 


PCM 


10-3 


207 


0.5 


17.9 


66.7 


15.0 


0.0 


3.0 


0.59 


PCM 


10" 4 


207 


31.4 


41.1 


26.6 


0.5 


0.5 


4.0 


0.80 


PCM 


10~ 5 


208 


42.8 


50.0 


7.2 


0.0 


0.0 


4.4 


0.61 


NIC 


10- ■ 


208 


0.0 


0.0 


0.5 


7.7 


91.8 


1.1 


0.30 


NIC 


10-2 


207 


0.0 


3.9 


33.8 


54.1 


8.2 


2.3 


0.68 


NIC 


10- 3 


207 


12.1 


46.4 


39.1 


2.4 


0.0 


3.7 


0.71 


NIC 


10- 4 


207 


43.5 


44.9 


10.1 


1.4 


0.0 


4.3 


0.71 


NIC 


10- 5 


208 


52.4 


41.8 


5.8 


0.0 


0.0 


4.5 


0.60 


ADPCM 


10- 1 


207 


0.0 


0.0 


0.0 


3.9 


96.1 


1.0 


0.19 


ADPCM 


10-2 


206 


0.0 


1.5 


16.5 


65.0 


17.0 


2.0 


0.63 


ADPCM 


10- 3 


207 


22.7 


45.9 


28.0 


3.4 


0.0 


3.9 


0.79 


ADPCM 


10- 4 


208 


35.1 


52.4 


12.0 


0.5 


0.0 


4.2 


0.66 


ADPCM 


10- 5 


208 


41.8 


44.2 


13.9 


0.0 


0.0 


4.3 


0.69 


SLC" 


10-' 


206 


0.0 


0.0 


3.4 


27.7 


68.9 


1.3 


0.54 


SLC 


10-2 


206 


1.0 


17.5 


55.3 


25.2 


1.0 


2.9 


0.71 


SLC 


10- 3 


207 


40.1 


44.9 


14.5 


0.5 


0.0 


4.3 


0.71 


SLC 


10- 4 


206 


46.1 


44.7 


9.2 


0.0 


0.0 


4.4 


0.65 


SLC 


10- 5 


206 


43.7 


38.8 


16.5 


1.0 


0.0 


4.3 


0.76 


Noise 10 dBrnC 


201 


31.3 


50.2 


17.9 


0.5 


0.0 


4.1 


0.70 


Noise 20 dBrnC 


206 


7.8 


37.9 


48.5 


5.8 


0.0 


3.5 


0.72 


Noise 30 dBrnC 


205 


3.4 


14.6 


53.7 


27.3 


1.0 


2.9 


0.77 


Noise 40 dBrnC 


206 


0.0 


7.8 


35.0 


54.4 


2.9 


2.5 


0.68 


Q— 10 dB 


208 


0.0 


2.4 


11.5 


69.7 


16.3 


2.0 


0.61 


Q— 20 dB 


206 


14.6 


37.4 


40.3 


7.8 


0.0 


3.6 


0.83 



Notation: 

PCM = 48-kb/s 15-segment PCM (mid-tread) 
NIC = 51-kb/s NIC PCM 

ADPCM = 48-kb/s ADPCM (with step-size leak) 
SLC = 48-kb/s SLC ADM 

Table VIII— Detailed tabulation of subjective scoring 
for number of codecs in tandem 





Tandem 




% 


% 


% 


% 


% 






Codec 


Encodings 


Votes 


Exc. 


Good 


Fair 


Poor 


Uns. 


MOS 


a 


PCM 


1 


106 


35.9 


55.7 


6.6 


1.9 


0.0 


4.3 


0.66 


PCM 


2 


105 


41.9 


45.7 


11.4 


1.0 


0.0 


4.3 


0.70 


PCM 


4 


106 


22.6 


60.4 


14.2 


2.8 


0.0 


4.0 


0.69 


PCM 


6 


106 


21.7 


51.9 


23.6 


2.8 


0.0 


3.9 


0.75 


PCM 


8 


106 


16.0 


41.5 


36.8 


5.7 


0.0 


3.7 


0.81 








(continued) 
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Table VIII (cont) 










PCMi 


1 


106 


14.2 


52.8 


31.1 


1.9 


0.0 


3.8 


0.70 


PCMi 


2 


106 


12.3 


34.9 


46.2 


6.6 


0.0 


3.5 


0.79 


PCMi 


4 


106 


0.0 


15.1 


58.5 


26.4 


0.0 


2.9 


0.63 


PCMi 


8 


106 


0.0 


2.8 


34.0 


53.8 


9.4 


2.3 


0.68 


NIC 


1 


106 


7.5 


51.9 


33.0 


7.5 


0.0 


3.6 


0.74 


NIC 


2 


106 


2.8 


34.9 


42.5 


19.8 


0.0 


3.2 


0.79 


NIC 


4 


106 


0.0 


7.5 


34.0 


46.2 


12.3 


2.4 


0.79 


NIC 


8 


106 


0.0 


0.9 


13.2 


48.1 


37.7 


1.8 


0.70 


ADPCM 


1 


106 


22.6 


41.5 


31.1 


4.7 


0.0 


3.8 


0.83 


ADPCM 


2 


105 


1.9 


34.3 


49.5 


14.3 


0.0 


3.2 


0.71 


ADPCM 


4 


106 


0.9 


8.5 


49.1 


39.6 


1.9 


2.7 


0.70 


ADPCM 


8 


106 


0.0 


0.9 


17.9 


53.8 


27.4 


1.9 


0.70 


SLC™ 


1 


104 


27.9 


40.4 


26.0 


4.8 


1.0 


3.9 


0.90 


SLC 


2 


105 


13.3 


45.7 


33.3 


6.7 


1.0 


3.6 


0.83 


SLC 


4 


106 


0.9 


10.4 


44.3 


42.5 


1.9 


2.7 


0.73 


SLC 


8 


106 


0.0 


1.9 


26.4 


47.2 


24.5 


2.1 


0.76 


ADPCM* 


1 (at 16 kb/s) 


106 


0.0 


1.0 


13.2 


41.5 


44.3 


1.7 


0.73 


ADPCM* 


1 (at 24 kb/s) 


106 


0.0 


11.3 


52.8 


32.1 


3.8 


2.7 


0.71 


ADPCM* 


1 (at 32 kb/s) 


105 


29.5 


41.0 


25.7 


3.8 


0.0 


4.0 


0.84 


ADPCM* 


1 (at 48 kb/s) 


106 


26.4 


50.9 


21.7 


1.0 


0.0 


4.0 


0.72 



* ADPCM conditions (without step-size leak) which tie into those of Table V. 
Notation: 

PCM = 64-kb/s 15-segment PCM (mid-tread) 

PCMi = 48-kb/s 15-segment PCM (mid-tread) 

NIC = 35-kb/s NIC PCM 

ADPCM = 32-kb/s ADPCM (without step-size leak) 

SLC = 37.7-kb/s SLC ADM 

Table IX — Detailed tabulation of subjective scoring 
for local reference connection tests 







% 


% 


% 


% 


% 






Connection 


Votes 


Exc. 


Good 


Fair 


Poor 


Uns. 


MOS 


a 


AL-ACO-AL 


106 


25.5 


55.7 


16.0 


2.8 


0.0 


4.0 


0.73 


AL-DCO-AL 


106 


22.6 


55.7 


18.9 


2.8 


0.0 


4.0 


0.73 


AL-ACO-P 


106 


9.4 


57.5 


29.2 


3.8 


0.0 


3.7 


0.68 


AL-ACO-Pi 


105 


6.7 


40.0 


39.0 


13.3 


1.0 


3.4 


0.83 


AL-ACO-N 


106 


3.8 


34.0 


50.0 


12.3 


0.0 


3.3 


0.73 


AL-ACO-A 


106 


15.1 


37.7 


41.5 


5.7 


0.0 


3.6 


0.81 


AL-ACO-S 


106 


4.7 


51.9 


38.7 


4.7 


0.0 


3.6 


0.66 


P-ACO-AL 


105 


17.1 


51.4 


28.6 


2.9 


0.0 


3.8 


0.74 


Pl-ACO-AL 


106 


6.6 


43.4 


41.5 


7.5 


0.9 


3.5 


0.77 


N-ACO-AL 


106 


1.9 


37.7 


51.9 


7.5 


0.9 


3.3 


0.68 


A-ACO-AL 


106 


3.8 


47.2 


40.6 


8.5 


0.0 


3.5 


0.70 


S-ACO-AL 


106 


6.6 


53.8 


34.0 


5.7 


0.0 


3.6 


0.69 


P-ACO-P 


106 


10.4 


55.7 


33.0 


0.9 


0.0 


3.8 


0.64 


Pl-ACO-Pi 


104 


5.8 


33.7 


50.0 


10.6 


().() 


3.4 


0.74 


N-ACO-N 


106 


1.9 


29.2 


36.8 


27.4 


4.7 


3.0 


0.91 


A-ACO-A 


106 


3.8 


28.3 


53.8 


13.2 


0.9 


3.2 


0.75 


S-ACO-S 


106 


0.9 


26.4 


59.4 


13.2 


0.0 


3.2 


0.64 


P-ACO-Pi 


105 


2.9 


39.0 


51.4 


5.7 


0.9 


3.4 


0.68 


P-ACO-N 


106 


0.9 


27.4 


54.7 


17.0 


0.0 


3.1 


0.68 


P-ACO-A 


106 


4.7 


30.2 


54.7 


10.4 


0.0 


3.3 


0.71 


P-ACO-S 


105 


2.9 


55.2 


38.1 


3.8 


0.0 


3.6 


0.62 


Pl-ACO-P 


106 


5.7 


45.3 


38.7 


10.4 


0.0 


3.5 


0.75 


Pl-ACO-N 


106 


0.9 


17.9 


61.3 


19.8 


0.0 


3.0 


0.64 


Pl-ACO-A 


106 


0.9 


15.1 


63.2 


19.8 


0.9 


3.0 


0.65 


Pl-ACO-S 


106 


1.9 


33.0 


50.9 


14.2 


0.0 


3.2 


0.70 


N-ACO-P 


106 


0.9 


33.0 


51.9 


12.3 


1.9 


3.2 


0.73 


N-ACO-Pi 


106 


2.8 


17.0 


48.1 


29.2 


2.8 


2.9 


0.82 


N-ACO-A 


105 


1.9 


26.7 


55.2 


15.2 


1.0 


3.1 


0.72 


N-ACO-S 


106 


0.9 


32.1 


50.9 


16.0 


0.0 


3.2 


0.70 


A-ACO-P 


105 


7.6 


34.3 


52.4 


5.7 


0.0 


3.4 


0.72 


A-ACO-Pi 


105 


3.8 


28.6 


48.6 


18.1 


1.0 


3.2 


0.79 


A-ACO-N 


104 


0.0 


14.4 


58.7 


25.0 


1.9 


2.9 


0.67 








(continued) 
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A-ACO-S 


106 


3.8 


31.1 


52.8 


12.3 


0.0 


3.3 


0.72 


S-ACO-P 


106 


4.7 


44.3 


47.2 


3.8 


0.0 


3.5 


0.65 


S-ACO-Pi 


106 


0.0 


14.2 


55.7 


29.2 


0.9 


2.8 


0.67 


S-ACO-N 


106 


1.9 


24.5 


52.8 


19.8 


0.9 


3.1 


0.74 


S-ACO-A 


106 


0.0 


18.9 


67.0 


14.2 


0.0 


3.1 


0.57 



Notation: 

P = 64-kb/s 15-segment PCM (mid-tread) 

Pi = 48-kb/s 15-segment PCM (mid-tread) 

N = 35-kb/s NIC PCM 

A = 32-kb^ ADPCM (without step-size leak) 

S = 37.7-kb/s SLC ADM 

AL = analog loop 

ACO = analog central office 

DCO = digital central office 



Table X — Detailed tabulation of subjective scoring for exchange 
reference connection tests 







% 


% 


% 


% 


% 






Connection 


Votes 


Exc. 


Good 


Fair 


Poor 


Uns. 


MOS 


a 


AL-ACO-AEX-ACO-AL 


106 


7.5 


49.1 


39.6 


3.8 


0.0 


3.6 


0.68 


P-ACO-P-ACO-P 


106 


5.7 


37.7 


54.7 


1.9 


0.0 


3.5 


0.63 


Pl-ACO-Pi-ACO-Pi 


106 


3.8 


23.6 


40.6 


27.4 


4.7 


2.9 


0.92 


N-ACO-N-ACO-N 


106 


0.0 


7.5 


44.3 


42.5 


5.7 


2.5 


0.72 


A-ACO-A-ACO-A 


105 


0.0 


12.4 


61.0 


21.0 


5.7 


2.8 


0.72 


S-ACO-S-ACO-S 


106 


0.0 


7.5 


61.3 


30.2 


0.9 


2.8 


0.60 


P-DCO-P-DCO-P 


106 


36.8 


50.0 


13.2 


0.0 


0.0 


4.2 


0.67 


Pl-DCO-Pi-DCO-Pi 


106 


14.2 


60.4 


19.8 


5.7 


0.0 


3.8 


0.73 


N-DCO-N-DCO-N 


106 


10.4 


50.9 


36.8 


1.9 


0.0 


3.7 


0.68 


A-DCO-A-DCO-A 


106 


15.1 


47.2 


32.1 


5.7 


0.0 


3.7 


0.79 


S-DCO-S-DCO-S 


105 


1.9 


11.4 


60.0 


25.7 


1.0 


2.9 


0.69 


Noise 10 dBrnC 


212 


20.3 


56.6 


23.1 


0.0 


0.0 


4.0 


0.66 


Noise 20 dBrnC 


211 


2.8 


29.9 


47.9 


16.6 


2.8 


3.1 


0.82 


Noise 30 dBrnC 


211 


0.0 


8.5 


30.8 


46.9 


13.7 


2.3 


0.82 


Noise 40 dBrnC 


212 


0.0 


1.9 


11.8 


44.8 


41.5 


1.7 


0.74 


Q— 5dB 


212 


0.0 


0.0 


0.0 


10.8 


89.2 


1.1 


0.31 


Q— 10 dB 


211 


0.0 


0.9 


9.0 


39.8 


50.2 


1.6 


0.69 


Q— 15 dB 


211 


0.9 


5.7 


37.4 


46.0 


10.0 


2.4 


0.78 


Q— 20 dB 


211 


5.7 


30.3 


47.4 


16.1 


0.5 


3.3 


0.81 


Q— 25 dB 


210 


32.4 


48.6 


15.7 


3.3 


0.0 


4.1 


0.78 



Notation: 

P = 64-kb/s 15-segment PCM (mid-tread) 

Pi = 48-kb/s 15-segment PCM (mid-tread) 

N = 35-kb/s NIC PCM 

A = 32-kb/s ADPCM (without step-size leak) 

S = 37.7-kb/s SLC ADM 

AL = analog loop 

ACO = analog central office 

DCO = digital central office 

aex = analog exchange trunk 
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Table XI — Detailed tabulation of subjective scoring 
for toll reference connection conditions — part 1 



Connection 



Votes 



% 
Exc. 



% 
Good 



% 
Fair 



% 
Poor 



% 
Uns. 



MOS 



AL-Si-AL 

AL-Si-P 

AL-S1-P1 

AL-Si-N 

AL-Si-A 

AL-Si-S 

AL-S2-AL 

AL-S2-P 

AL-S2-P1 

AL-S2-N 

AL-S2-A 

AL-S2-S 

AL-S3-AL 

AL-S3-P 

AL-S3-P1 

AL-S3-N 

AL-S3-A 

AL-S3-S 

AL-Li-AL 

AL-Li-P 

AL-L1-P1 

AL-Li-N 

AL-Li-A 

AL-Li-S 

AL-L2-AL 

AL-L 2 -P 

AL-L2-P1 

AL-L2-N 

AL-L2-A 

AL-L2-S 

AL-L3-AL 

AL-L3-P 

AL-L3-P1 

AL-L3-N 

AL-L3-A 

AL-L3-S 

AL-W-AL 

AL-W-P 

AL-W-Pi 

AL-W-N 

AL-W-A 

AL-W-S 

AL-D-AL 

AL-D-P 

AL-D-Pi 

AL-D-N 

AL-D-A 

AL-D-S 

Noise 10 dBrnC 

Noise 20 dBrnC 
Noise 30 dBrnC 
Noise 40 dBrnC 
Q— 5dB 
Q— 10 dB 
Q— 15 dB 
Q— 20 dB 
Q— 25 dB 



112 


17.0 


58.0 


22.3 


2.7 


0.0 


3.9 


0.70 


102 


19.6 


50.0 


30.4 


0.0 


0.0 


3.9 


0.70 


111 


12.6 


42.3 


36.0 


9.0 


0.0 


3.6 


0.82 


112 


2.7 


35.7 


47.3 


13.4 


0.9 


3.3 


0.75 


112 


10.7 


44.6 


38.4 


6.3 


0.0 


3.6 


0.76 


111 


5.4 


54.1 


35.1 


5.4 


0.0 


3.6 


0.68 


111 


30.6 


49.5 


18.0 


1.8 


0.0 


4.1 


0.74 


112 


18.8 


56.3 


23.2 


1.8 


0.0 


3.9 


0.70 


111 


9.9 


53.2 


30.6 


5.4 


0.9 


3.7 


0.77 


112 


6.3 


36.6 


40.2 


17.0 


0.0 


3.3 


0.83 


102 


8.8 


40.2 


41.2 


9.8 


0.0 


3.5 


0.79 


112 


14.3 


43.8 


36.6 


5.4 


0.0 


3.7 


0.78 


112 


25.9 


57.1 


15.2 


1.8 


0.0 


4.1 


0.69 


112 


30.4 


50.0 


19.6 


0.0 


0.0 


4.1 


0.70 


102 


11.8 


43.1 


41.2 


3.9 


0.0 


3.6 


0.74 


102 


7.8 


43.1 


41.2 


7.8 


0.0 


3.5 


0.75 


102 


4.9 


43.1 


41.2 


10.8 


0.0 


3.4 


0.75 


112 


15.2 


49.1 


30.4 


5.4 


0.0 


3.7 


0.78 


111 


2.7 


15.3 


51.4 


27.0 


3.6 


2.9 


0.81 


112 


1.8 


19.6 


49.1 


28.6 


0.9 


2.9 


0.76 


112 


0.9 


16.1 


55.4 


27.7 


0.0 


2.9 


0.68 


102 


1.0 


10.8 


50.0 


37.3 


1.0 


2.7 


0.70 


112 


0.9 


10.7 


50.0 


35.7 


2.7 


2.7 


0.72 


101 


1.0 


20.8 


51.5 


26.7 


0.0 


3.0 


0.72 


112 


1.8 


14.3 


52.7 


31.3 


0.0 


2.9 


0.71 


111 


2.7 


28.8 


46.8 


21.6 


0.0 


3.1 


0.77 


111 


0.9 


13.5 


55.0 


30.6 


0.0 


2.9 


0.67 


112 


0.0 


13.4 


51.8 


33.9 


0.9 


2.8 


0.68 


111 


0.9 


9.9 


57.7 


29.7 


1.8 


2.8 


0.68 


111 


1.8 


21.6 


54.1 


22.5 


0.0 


3.0 


0.72 


112 


17.9 


62.5 


18.8 


0.9 


0.0 


4.0 


0.63 


112 


13.4 


50.0 


32.1 


4.5 


0.0 


3.7 


0.75 


112 


10.7 


45.5 


40.2 


3.6 


0.0 


3.6 


0.72 


112 


8.0 


43.8 


41.1 


7.1 


0.0 


3.5 


0.74 


112 


8.0 


42.0 


42.0 


8.0 


0.0 


3.5 


0.76 


112 


5.4 


39.3 


47.3 


8.0 


0.0 


3.4 


0.72 


112 


1.8 


20.5 


58.9 


18.8 


0.0 


3.1 


0.68 


112 


1.8 


10.7 


53.6 


33.9 


0.0 


2.8 


0.69 


102 


2.0 


6.9 


54.9 


35.3 


1.0 


2.7 


0.68 


101 


0.0 


9.9 


47.5 


41.6 


1.0 


2.7 


0.66 


112 


1.8 


7.1 


51.8 


39.3 


0.0 


2.7 


0.67 


112 


0.0 


10.7 


55.4 


33.0 


0.9 


2.8 


0.64 


111 


39.6 


48.6 


10.8 


0.9 


0.0 


4.3 


0.68 


102 


29.4 


53.9 


14.7 


2.0 


0.0 


4.1 


0.71 


112 


17.9 


53.6 


26.8 


1.8 


0.0 


3.9 


0.71 


112 


8.0 


33.9 


45.5 


12.5 


0.0 


3.4 


0.80 


112 


18.8 


57.1 


20.5 


3.6 


0.0 


3.9 


0.73 


111 


22.5 


38.7 


34.2 


4.5 


0.0 


3.8 


0.84 


224 


44.2 


46.0 


9.8 


0.0 


0.0 


4.3 


0.65 


214 


3.7 


43.9 


47.7 


4.7 


0.0 


3.5 


0.65 


214 


0.9 


15.0 


48.6 


34.6 


0.9 


2.8 


0.73 


224 


0.0 


2.7 


29.0 


60.7 


7.6 


2.3 


0.63 


223 


0.0 


0.0 


0.0 


21.1 


78.9 


1.2 


0.41 


226 


0.0 


0.0 


7.1 


51.3 


41.6 


1.7 


0.61 


223 


0.0 


5.8 


37.7 


43.9 


12.6 


2.4 


0.77 


214 


13.1 


23.4 


37.9 


23.8 


1.9 


3.2 


1.01 


224 


32.1 


43.8 


21.0 


3.1 


0.0 


4.1 


0.81 



Notation: 

P, Pi, N, A, S, AL— see Table X 

Si, S 2 , S 3 , L,, L 2 , L 3 , W, D— see Figs. 19a, 19b, and 19c in text. 
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Table XII — Detailed tabulation of subjective scoring 
for toll reference connection conditions — part 2 







% 


% 


96 


% 


% 






Connection 


Votes 


Exc. 


Good 


Fair 


Poor 


Uns. 


MOS 


a 


P-Si-P 


108 


40.7 


50.0 


9.3 


0.0 


0.0 


4.3 


0.63 


Pi-Si-Pi 


108 


10.2 


48.1 


37.0 


4.6 


0.0 


3.6 


0.73 


N-Si-N 


107 


2.8 


26.2 


51.4 


17.8 


1.9 


3.1 


0.78 


A-Si-A 


108 


13.9 


35.2 


35.2 


15.7 


0.0 


3.5 


0.92 


S-Si-S 


108 


6.5 


45.4 


41.7 


6.5 


0.0 


3.5 


0.71 


P-S2-P 


108 


23.1 


64.8 


12.0 


0.0 


0.0 


4.1 


0.58 


P1-S2-P1 


107 


16.8 


50.5 


29.9 


2.8 


0.0 


3.8 


0.74 


N-S2-N 


108 


6.5 


23.1 


55.6 


14.8 


0.0 


3.2 


0.77 


A-S2-A 


108 


5.6 


33.3 


52.8 


8.3 


0.0 


3.4 


0.71 


S-S2-S 


108 


13.9 


51.9 


28.7 


5.6 


0.0 


3.7 


0.76 


P-S3-P 


108 


31.5 


56.5 


10.2 


1.9 


0.0 


4.2 


0.68 


P1-S3P1 


107 


11.2 


38.3 


44.9 


4.7 


0.9 


3.5 


0.79 


N-S3-N 


108 


2.8 


34.3 


43.5 


17.6 


1.9 


3.2 


0.82 


A-S3-A 


106 


3.8 


34.0 


53.8 


8.5 


0.0 


3.3 


0.68 


S-S3-S 


107 


14.0 


50.5 


29.9 


5.6 


0.0 


3.7 


0.77 


P-Li-P 


108 


0.0 


13.0 


59.3 


27.8 


0.0 


2.9 


0.62 


P1-L1-P1 


108 


0.0 


10.2 


59.3 


30.6 


0.0 


2.8 


0.60 


N-Li-N 


108 


0.0 


8.3 


60.2 


28.7 


2.8 


2.7 


0.64 


A-Li-A 


108 


0.0 


6.5 


54.6 


38.0 


0.9 


2.7 


0.61 


S-Li-S 


107 


0.0 


4.7 


57.0 


37.4 


0.9 


2.7 


0.58 


P-L2-P 


108 


0.0 


17.6 


58.3 


24.1 


0.0 


2.9 


0.64 


P1-L2-P1 


108 


0.0 


7.4 


61.1 


28.7 


2.8 


2.7 


0.63 


N-L2-N 


107 


0.0 


4.7 


57.9 


35.5 


1.9 


2.7 


0.60 


A-L2-A 


108 


0.0 


6.5 


58.3 


34.3 


0.9 


2.7 


0.60 


S-L2-S 


108 


0.0 


5.6 


60.2 


33.3 


0.9 


2.7 


0.58 


P-L3-P 


106 


17.9 


60.4 


21.7 


0.0 


0.0 


4.0 


0.63 


P1-L3-P1 


108 


12.0 


49.1 


33.3 


5.6 


0.0 


3.7 


0.76 


N-L3-N 


107 


1.9 


27.1 


56.1 


15.0 


0.0 


3.2 


0.69 


A-L3-A 


108 


6.5 


35.2 


50.0 


8.3 


0.0 


3.4 


0.73 


S-L3-S 


107 


2.8 


47.7 


42.1 


7.5 


0.0 


3.5 


0.67 


P-W-P 


108 


0.0 


13.9 


63.0 


22.2 


0.9 


2.9 


0.62 


Pl-W-Pi 


108 


0.0 


8.3 


59.3 


31.5 


0.9 


2.8 


0.61 


N-W-N 


107 


0.0 


1.9 


52.3 


44.9 


0.9 


2.6 


0.55 


A-W-A 


106 


0.0 


2.8 


57.5 


37.7 


1.9 


2.6 


0.58 


S-W-S 


108 


0.0 


6.5 


56.5 


36.1 


0.9 


2.7 


0.60 


P-D-P 


108 


37.0 


51.9 


10.2 


0.9 


0.0 


4.3 


0.67 


P1-D-P1 


106 


18.9 


43.4 


33.0 


4.7 


0.0 


3.8 


0.81 


N-D-N 


108 


0.9 


37.0 


50.0 


12.0 


0.0 


3.3 


0.68 


A-D-A 


107 


13.1 


40.2 


38.3 


8.4 


0.0 


3.6 


0.82 


S-D-S 


108 


17.6 


50.0 


31.5 


0.9 


0.9 


3.8 


0.71 


Noise 10 dBrnC 


216 


45.8 


44.4 


9.7 


0.0 


0.0 


1.4 


0.65 


Noise 20 dBrnC 


215 


8.4 


52.1 


36.7 


2.8 


0.0 


3.7 


0.67 


Noise 30 dBrnC 


214 


1.4 


13.6 


52.8 


30.8 


1.4 


2.8 


0.73 


Noise 40 dBrnC 


216 


0.0 


0.0 


24.5 


58.8 


16.7 


2.1 


0.64 . 


Q— 5dB 


215 


0.0 


0.0 


0.0 


16.7 


83.3 


1.2 


0.37 


Q— 10 dB 


216 


0.0 


0.0 


9.7 


54.2 


36.1 


1.7 


0.62 


Q— 15 dB 


215 


0.9 


9.8 


38.6 


46.0 


4.7 


2.6 


0.77 


Q— 20 dB 


213 


12.7 


36.6 


41.8 


8.9 


0.0 


3.5 


0.83 


Q— 25 dB 


216 


50.0 


38.4 


10.6 


0.9 


0.0 


4.4 


0.71 



Notation: 
See Table XI. 
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